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Abstract 

The  use  of  decomposition  as  a  procedure  for  improving  the  consistency  of  sub- 
jective probability  encoding  is  discussed.  Using  a  psychometric  measurement 
model,  an  expression  is  developed  that  describes  the  random  error  associated 
with  decomposition  estimates  as  a  function  of  characteristics  of  the  component 
assessments.  Decomposition  is  compared  to  direct  assessment  in  terms  of  the 
percent  change  in  measurement  error  that  can  be  attributed  to  the  use  of  de- 
composition. The  results  are  derived  for  the  case  of  independent  elicitation 
errors  and  for  the  more  general  case  of  dependent  errors.  Potential  benefits 
of  decomposition  are  specified  and  reconmiendations  made  on  how  to  utilize 
decomposition  as  an  approach  for  error  control. 


1     Introduction 

A  critical  issue  in  decision  making  is  the  elicitation  and  encoding  of  uncertainty 
in  the  form  of  subjective  probabilities.  There  are  numerous  reviews  and  tutorials 
that  describe  and  compare  a  variety  of  methods  for  eliciting  probabilities  (e.g., 
Hogarth,  1975;  Huber,  1974;  Lichtenstein,  Fischhoff,  k  Phillips,  1977,  1982; 
Lindley,  1986;  Lindley,  Tversky,  k  Brown,  1979;  Spetzler  k,  Stael  von  Holstein, 
1975;  Wallsten  k  Budescu,  1983).  A  basic  problem  discussed  throughout  this 
literature  has  been  the  potential  for  encoded  probabilities  to  contain  serious 
inaccuracies  and  inconsistencies.  For  instance,  Wallsten  k  Budescu  (1983)  note 
that: 

there  is,  in  addition,  a  growing  literature  suggesting  that  human 
judgment  is  frequently  malleable,  inconsistent,  and  subject  to  bias 
(e.g.,  Fischhoff,  Slovic,  k  Lichtenstein,  1980;  Hogarth,  1975;  Slovic, 
Fischhoff,  k  Lichtenstein,  1977;  Tversky  k  Kahneman,  1973;  1974). 
Note,  however,  that  the  fact  that  people  can  be  shown  to  be  irra- 
tional when  left  to  their  own  devices  does  not  imply  that  they  will 
necessarily  be  irrational  in  all  cases.  In  particular,  a  careful  deci- 
sion or  risk  analyst  should  be  able  to  structure  a  situation  so  that 
bias  and  inconsistency  are  minimized  and  the  encoded  probabilities 
closely  represent  the  judge's  carefully  considered  opinion,  (p.  155) 

This  paper  is  concerned  with  how  an  analyst  might  structure  the  encoding 
situation  in  order  to  reduce  inconsistency.  Specifically,  we  provide  a  framework 
for  evaluating  the  effectiveness  of  elicitations  that  rely  upon  decomposition.  The 
evaluation  uses  a  psychometric  measurement  perspective  to  provide  a  compar- 
ative analysis  of  the  reliability  of  probability  assessments  based  upon  decom- 
position versus  direct  elicitation.  Addressing  this  question  leads  to  a  better 
understanding  of  decomposition  processes  for  probability  encoding  and  has  the 
potential  to  improve  both  the  theory  and  practice  of  decision  analysis. 


The  remainder  of  the  paper  is  organized  as  follows:  Section  2  describes 
the  decomposition  approach.  Section  3  describes  the  psychometric  model  that 
is  used  to  evaluate  the  elicitations.  Section  4  utilizes  that  model  to  derive 
results  on  the  relative  reliability  of  decomposition  and  direct  assessment.  Section 
5  extends  those  results  while  relaxing  certain  restrictive  assumptions  of  the 
original  model.  Finally,  section  6  discusses  the  implications  of  these  results  for 
the  practice  of  probability  encoding. 

2     Decomposition 

Decomposition  is  often  regarded  as  a  useful  technique  for  reducing  the  complex- 
ity of  difficult  judgment  problems:  A  large,  messy  problem  is  divided  into  a  set  of 
smaller  and  presumably  easier  judgments.  These  judgments  are  then  combined 
using  an  aggregation  rule  based  upon  statistical  or  mathematical  considerations. 
An  obvious  advantage  of  this  approach  Lb  the  reduction  of  information  process- 
ing demands,  since  the  judge  can  isolate  and  concentrate  on  selected  portions 
of  the  problem  in  turn.  Furthermore,  the  laborious  task  of  information  com- 
bination can  then  be  handled  by  a  formal  model,  perhaps  implemented  on  a 
computer. 

This  paper  examines  the  application  of  decomposition  to  the  elicitation  of 
subjective  probabilities.  Consider  the  following  examples: 

Example  1.  The  market  price  of  oil  is  an  important  variable  in  many  eco- 
nomic planning  models.  An  analyst  might  ask  an  oil  industry  expert  to  assess 
a  probability  distribution  for  the  price  of  oil  five  years  in  the  future.  The  ex- 
pert could  consider  a  variety  of  factors  that  might  influence  the  future  price  of 
the  commodity,  including  the  political  situation  in  the  Middle  East,  the  market 
attractiveness  of  alternate  energy  sources,  the  level  of  oil  exploration  activities, 
and  the  projected  economic  health  of  various  national  economies. 

Example  2.  A  physician  might  need  to  predict  the  survival  time  of  a  patient 


who  has  recently  undergone  an  experimental  treatment  (e.g.,  an  artificial  heart 
implant).  The  physician's  assessment  could  be  based  upon  a  number  of  related 
considerations:  How  advanced  was  the  patient's  disease?  Was  the  procedure 
correctly  implemented?  Is  the  patient  susceptible  to  particular  complications? 
What  is  the  patient's  emotional  and  physical  strength? 

Example  S.  A  venture  capitalist  might  be  considering  investing  in  a  firm 
developing  an  untried  technology.  In  estimating  the  probability  of  the  venture's 
success,  key  factors  include:  the  professional  qualifications  of  the  research  and 
development  team,  the  experience  and  competence  of  the  management  team, 
the  size  of  the  potential  market  for  the  eventual  product,  the  general  state  of  the 
economy,  and  other  factors  that  might  influence  the  attractiveness  of  competing 
investment  opportunities. 

In  each  of  these  examples,  the  target  probabilities  are  heavily  context  de- 
pendent: It  is  diflBcult  to  think  of  the  target  event  without  reference  to  other 
events  that  may  be  related  either  causally  or  statistically.  Holistic  or  direct  elic- 
itation  of  the  probability  may  be  problematic  since  keeping  track  of  these  other 
events  vastly  increases  the  complexity  of  the  assessment.  This  could  lead  to  an 
ambiguous  or  inconsistent  consideration  of  these  background  events,  leading  in 
turn  to  encoding  errors. 

A  decomposition  approach  explicitly  captures  the  relationship  between  the 
target  event  and  the  background  events  in  the  form  of  conditional  probabilities 
of  the  target  event.  For  instance,  different  distributions  for  the  price  of  oil 
might  be  assessed  conditional  upon  the  outcome  of  the  Iran-Iraq  war.  Similarly, 
distributions  could  be  assessed  conditional  upon  the  occurrence  of  scenarios 
consisting  of  multiple  events  (e.g.,  the  Iran-Iraq  war  remains  stalemated,  no 
significant  new  oil  fields  are  discovered,  and  U.S.  demand  for  oil  remains  level). ^ 

Once  individual  conditional  distributions  are  elicited,  the  law  of  total  proba- 

'  While  the  decompoiition  approach  can  be  readiljr  extended  to  the  continuooi  caie,  the  pretcnt  dUcut- 
•ion  it  limited  to  ditcreCe  events,  both  for  the  target  and  backfrouad  event!. 


bility  provides  a  convenient  method  for  aggregation.  Suppose  the  probability  of 
the  target  event,  denoted  event  A,  is  assessed  conditional  upon  each  of  a  set  of 
background  events,  denoted  Bi,...,Bn.  Each  of  the  events  5»  could  either  be 
a  single  event  or  be  a  scenario,  composed  of  the  intersection  of  multiple  events. 
The  only  requirement  is  that  Bi  through  Bn  form  a  mutually  exclusive  and 
exhaustive  partition  of  the  relevant  event  space.  U  this  condition  is  satisfied, 
then  ^^1=1  Pr{5i)  =  1  and  the  probability  of  the  target  event  is  as  follows: 

?t{A)  =  T^t{A\B,)?t{B,).  (1) 

Clearly,  elicitation  by  decomposition  requires  greater  effort  than  direct  as- 
sessment of  uncertainty.  For  each  background  event,  both  a  conditional  and 
marginal  probability  estimate  must  be  obtained.  Knowing  whether  this  addi- 
tional effort  is  warranted  requires  a  greater  understanding  of  the  decomposition 
process.  This  paper  provides  a  first  step  in  this  direction  by  establishing  the 
impact  of  the  decomposition  procedure  on  the  reliability  of  the  assessed  proba- 
bilities. 

3     The  Psychometric  Model 

In  their  recent  paper,  Wallsten  and  Budescu  (1983)  describe  a  psychometric 
framework  for  evaluating  the  accuracy  of  probability  encoding.  Drawing  from 
the  literature  on  psychological  measurement  and  scaling,  they  propose  the  fol- 
lowing model:  Each  encoded  probability  is  considered  to  be  a  random  variable, 
X,  that  is  composed  of  a  fixed  true  measure,  t,  and  a  variable  error,  e: 

x  =  t  +  e.  (2) 

The  following  basic  assumptions  are  made  about  equation  2:  (a)  The  expected 
value  of  the  error  is  zero:  E(e)  =  0.  (b)  The  true  and  error  values  are  uncorre- 
lated:  Corr(<,  e)  =  0.  (c)  For  any  pair  of  independent  measurements  the  error 


scores  are  uncorrelated:  CoiT(ei,  ey)  =  0,  where  t  ^  ;*.  (d)  The  true  score  of  one 
measurement  is  uncorrelated  with  the  error  in  another:  Corr(f,,  ey)  =  0,  where 

Wallsten  and  Budescu  also  note  that  care  should  be  taken  in  interpreting 
the  sense  in  which  the  t  scores  are  "true"  measures  of  probability: 

It  would  be  inappropriate  to  think  of  a  person's  opinion  about  a 
set  of  events  as  existing  within  that  person  in  a  precise,  fixed  fashion 
just  waiting  to  be  measured  (Fischhoff,  Slovic,  k  Lichtenstein,  1980). 
Rather,  an  individual's  opinion  is  more-or-less  vaguely  formulated, 
and  upon  being  asked  to  evaluate  the  probability  of  an  outcome,  a 
person  will  search  his  or  her  memory  for  relevant  knowledge,  combine 
it  with  the  information  at  hand,  and  (presumably)  provide  the  best 
judgment  possible.  ...  If  the  same  situation  were  replicated  a  large 
number  of  times,  and  if  the  person  had  no  memory  of  his  or  her 
previous  judgments,  the  encoded  probabilities,  x,  would  give  rise  to 
a  distribution  for  that  particular  individual.  A  convenient  way  to 
define  the  true  score,  <,  is  as  the  expected  value  of  this  hypothetical 
distribution  that  would  be  obtained  across  a  series  of  statistically 
independent  judgments  by  a  given  individual,  (p.  153) 

Further,  the  variance  of  the  repeated  assessments  can  be  represented  by  the 
variance  of  the  error  scores,  af ,  termed  the  error  variance.  Its  square  root,  <Te, 
is  the  standard  error  of  measttrement.  Using  this  framework,  maximizing  the 
reliability  of  probability  encodings  is  acheived  by  minimizing  this  error  variance. 
When  working  with  this  model,  it  is  important  to  note  and  maintain  the 
distinction  between  random  and  systematic  sources  of  error.  In  particular,  an 
analysis  of  reliability  only  considers  the  former.  For  instance,  when  comparing 
two  different  measurement  techniques,  one  might  observe  consistent,  predictable 
differences  in  the  true  scores  depending  upon  which  technique  is  utilized.  An 
examination  of  reliability  does  not  address  this  potentially  important  source 


of  error.  On  the  other  hand,  if  random  errors  were  large  enough,  accurate 
measurement  would  not  be  possible  with  either  technique.  Thus,  controlling 
random  error  can  be  thought  of  as  a  necessary  though  not  sufficient  condition 
for  accurate  elicitation  (for  further  details,  see  Wallsten  k  Budescu,  1983,  pp. 
152-154,  and  the  references  cited  there). 

4    Independent  Component  Ellcitations 

In  order  to  compare  decomposition  to  direct  assessment  of  probabilities,  first, 
notation  is  defined  that  applies  the  measurement  model  to  the  two  assessment 
techniques.  Second,  the  measurement  error  associated  with  decomposition  is 
derived.  Finally,  the  two  techniques  are  compared  in  terms  of  the  percent  change 
in  measurement  error  that  can  be  attributed  to  the  use  of  decomposition. 

4.1     Notation  and  Assumptions 

The  decomposition  and  direct  estimates  of  the  probability  of  the  target  event, 
A,  are  denoted  a  and  a'  respectively.  The  probabilities  of  the  target  event 
conditional  upon  each  of  the  background  events  are  denoted  Pr(i4|5t)  =  Ci, 
while  the  marginal  probabilities  of  the  background  events  are  denoted  Pr(J3i)  = 
bt ,  so  that  equation  1  can  be  rewritten  as: 

a  =  |^c,6..  (3) 

In  order  to  maintain  the  assumptions  of  the  measurement  model,  it  is  important 

to  note  the  marginal  probabilities  of  the  background  events  are  not  completely 

independent:  X^"=i  6»  =  1.  Independence  is  preserved  by  treating  the  first  n  - 1 

marginal  probabilities  as  independent  and  expressing  bn  in  terms  of  the  others, 

bn  =  I  -  Yl^=i  if  This  allows  equation  3  to  be  rewritten  as 

n-l  /        n-l      \ 

a=^c6,  +  c„     1-^6,     ,  (4) 


which  is  equivalent  to: 

n-l 


a  =  Cn  +  '^(c,-Cn)bi.  (5) 

♦=1 

The  measurement  model  can  now  be  directly  applied  to  both  the  direct 
estimate  and  the  components  of  the  decomposition  estimate.  For  the  direct 
estimate, 

a'  =  a'  +  6',  (6) 

where  a'  is  the  true  score  and  6'  is  the  random  error,  with  its  standard  error  of 
measurement  (SEM)  denoted  by  (Tq.  Similarly,  for  the  marginal  probabilities  of 
the  background  events,  where  i  =  1 . . .  n, 

ft.  =  ^.  +  6i  (7) 

with  each  SEM  denoted  a,.  The  true  score  for  bn  is  denoted  ^„  =  1  -  YaI^  ^x, 
while  its  error  term  is  denoted  Sn  =  -  X)"r/  6i.  Finally,  for  the  conditional 
probabilities,  where  i  =  1 . . .  n, 

ci  =  ii  +  a  (8) 

with  each  SEM  denoted  r,. 

Applying  assumptions  (b),  (c),  and  (d)  of  the  measurement  model  implies 
that  the  various  error  terms  (6,  and  €,)  are  uncorrelated,  with  one  exception: 
The  correlation  between  bn  and  YHZl  k  is  -1.0.  These  admittedly  restrictive 
assumptions,  which  make  the  results  easier  to  interpret,  are  relaxed  in  section 
5. 

4.2     The  Error  Variance  of  Decomposition  Estimates 

This  notation  and  the  assumptions  described  above  can  be  used  to  derive,  in 
turn,  the  expected  value  and  variance  of  the  decomposition  assessment.  The 
expected  value  of  the  decomposition  estimate,  E(o),  can  be  readily  obtained 
from  equation  5: 

E(o)  =  E(c„)  +  "^E((c.-c„)6.).  (9) 


Using  the  independeDce  assumptions,  it  follows  that: 


n-l 


E(a)='yn  +  ^('y.-'yn)A.  (10) 

t=i 

One  consequence  of  assumption  (a)  of  section  3  is  that  the  estimates  of  the 
various  probabiUties  are  unbiased.  If  this  is  the  case,  then  the  expected  value 
of  the  decomposition  estimate,  given  in  equation  10,  should  be  equal  to  the  ex- 
pected value  of  the  direct  assessment,  which,  from  equation  6,  is  or*.  If  there  are 
systematic  sources  of  error  in  either  assessment  process,  then  the  two  expected 
values  would  not  normally  be  equal. 

The  error  variance  of  the  decomposition  estimate  is  denoted  by  Var(a)  =  c^. 
Using  equation  4,  this  variance  can  be  written  as  a  linear  combination  of  three 
components: 

a^    =    Var|^c.6A+Var|cJl-^'6y 

+  2Cov[^c«6„c„[l-^6j  I  j.  (11) 

In  the  appendix,  this  expression  is  shown  to  be  equivalent  to: 

+yc^?^+^nV<^i  (12) 

A  useful  special  case  occurs  when  the  various  probabilities  (conditional  and 
background)  are  assumed  to  have  the  same  SEM:  a,  =  <t  for  i  =  1 . . .  n  -  1  and 
Ti  =  T  for  I  =  1 . . .  n.  In  this  case,  equation  12  simplifies  to: 

cr^  =  <^' X!^'''  -  ^-^^  +  r^TP?+2{n  -  l)ah\  (13) 

1=1  1=1 

Equation  12  is  a  central  result  of  this  paper,  describing  the  random  error  as- 
sociated with  decomposition  as  a  function  of  the  true  scores  and  error  variances 
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of  its  components.  Several  observations  can  be  made  from  a  direct  examination 
of  equation  12:  First,  the  measurement  error  associated  with  decomposition,  a^, 
is  proportional  to  the  measurement  errors  of  the  component  probabilities,  a,  and 
7,.  Not  surprisingly,  the  less  error  there  is  in  the  conditional  and  background 
probability  estimates,  the  better  the  decomposition  estimate. 

Second,  the  decomposition  error  is  also  related  to  the  true  scores  of  the  com- 
ponents, although  the  relationship  is  not  as  straightforward.  The  decomposition 
error  expressed  as  a  function  of  ^i  is  minimized  when  the  expression  ^"=i  ^rf 
is  minimized  with  respect  to  the  values  ^i.  By  differentiating  this  expression 
with  respect  to  each  of  the  ^i,  and  recalling  the  constraint  that  ^JLj  ^3,  =  1, 
it  can  be  shown  that  error  variance  is  minimized  when  ^i  =  ^ni^nhf)  for  each 
I  =  1 ...  n  - 1.  One  implication  of  this  result  is  that  under  the  special  case  when 
the  errors  associated  with  the  conditional  probabilities  are  uniform,  Ti  =  T  for  all 
I  =  1 . . .  n,  then  the  ideal  situation  occurs  when  the  true  values  of  the  marginal 
probabilities  are  equal  (^t  =  1/n). 

A  similar  result  can  be  derived  for  the  true  scores  of  the  conditional  proba- 
bilities, 7,:  Decomposition  error  is  minimized  when  Y!i=\  ^H'^i  -  7n)^  is  mini- 
mized. Clearly,  this  occurs  when  the  diflferences  (7t  -  7n)  approach  zero,  which 
implies  7i  =  7„  for  all  values  of  i  =  1 . . .  n  - 1 .  In  other  words,  if  one  can  control 
which  conditioning  events  to  use,  it  would  be  desirable  to  use  events  aU  having 
the  same  conditional  probabilities.  ^ 

It  is  also  possible  to  examine  decomposition  error  as  a  function  of  the  number 
of  conditioning  events:  Using  equation  13  (which  assumes  equal  variances)  with 
uniform  values  for  the  true  scores  of  both  the  conditionals  (7»  =  7„  for  »  = 
1 ...  n  -  1)  and  the  marginals  (^t  =  1/n  for  i  =  1 . . .  n)  produces  the  following 

'If  kll  the  cooditioDkl  probkbilitici  were  known  to  be  equ»l,  then  deeoBpoiition  would  not  reftlljr  be 
needed  The  extent  to  which  the  true  valuei  of  the  condltionkit  c&n  be  controlled  by  either  the  »tac>ior 
or  the  knalytt  it  not  cleitr. 
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expression  for  decomposition  error:^ 

aj  =  ^  +  2(n  -  l)aV.  (14) 

Taking  the  first  derivative  of  the  right  side  of  equation  14  with  respect  to  n, 

d     o  /T\2 


^.2  =  -Q%^v. 


Setting  this  result  equal  to  0  and  solving  for  n  produces  the  following  expression 
for  n*,  the  value  of  n  that  minimizes  variance: 

"*  =  W  <'^' 

Thus,  the  optimal  number  of  conditioning  events  appears  to  be  a  function  of  the 
amount  of  error  in  the  marginal  probabilities,  since  n*  increases  as  a  decreases. 
Further  insight  into  this  result  is  obtained  by  examining  figure  1,  which  uses 
equation  14  to  plot  decomposition  error  as  a  function  of  n  for  different  values 
of  a  and  r.  Decomposition  error  drops  rapidly  as  n  increases,  but  quickly  levels 
off  and  begins  to  increase.  Thus,  it  seems  inadvisable  to  use  either  too  few  or 
too  many  conditioning  events.  However,  the  exact  number  of  events  does  not 
seem  to  be  critical  since,  in  the  neighborhood  of  the  minimum,  the  function  is 
relatively  flat,  particularly  for  smaller  values  of  a. 


Place  figure  1  about  here 


One  way  to  interpret  the  error  of  the  decomposition  estimate  is  to  con- 
ceptualize decomposition  as  a  weighted  average  of  n  independently  estimated 
conditional  probabihties.  The  ideal  situation  occurs  when  these  independently 
estimated  quantities  have  identical  expected  values.  This  corresponds  to  draw- 
ing a  sample  of  n  from  a  single  distribution.  Hence,  the  observation  that  the 
standard  error  of  the  estimate  decreases  as  n  increases  is  a  reflection  of  the  law 
of  large  numbers.    The  fact  that  error  actually  begins  to  rise  (albeit  slowly) 


°An  »n»lyiit  with  )«••  reitrictivc  kitumptioni  produce!  liBllbr  reiulti. 
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for  large  n  is  an  indication  that  the  weights  used  in  the  weighted  average  (the 
marginals)  contribute  error  as  well. 

Furthermore,  the  results  derived  above  regarding  the  ideal  distribution  of 
marginal  probabilities  can  be  thought  of  as  an  attempt  to  specify  an  optimal 
weighting  scheme.  When  the  conditional  probabilities  are  all  equally  prone  to 
error,  then  equal  weights  are  best.  However,  if  the  conditional  probabilities  have 
differing  degrees  of  error  associated  with  them,  it  is  desirable  to  shift  weight  away 
from  conditional  probabilities  that  are  less  precisely  assessed.  Also,  if  all  the 
conditionals  are  assessed  without  error,  Ti  =  0,  the  true  scores  of  the  marginals 
become  irrelevant,  and  the  specifics  of  the  weighting  scheme  do  not  matter. 

Viewing  the  decomposition  estimate  as  a  weighted  average  also  provides 
some  insight  into  the  standard  error's  sensitivity  to  the  true  scores  of  the  con- 
ditional probabilities.  There  are  two  aspects  of  the  conditionals  that  contribute 
to  the  total  error  associated  with  decomposition:  (1)  The  error  associated  with 
the  assessment  of  each  conditional  probability,  t„  and  (2)  the  extent  to  which 
the  true  scores  disagree.  Even  if  the  conditionals  were  assessed  without  error, 
Ti  =  0,  there  would  still  be  a  contribution  to  the  total  error,  unless  all  the  con- 
ditionals agreed.  Also,  there  is  an  interaction  between  this  source  of  error  and 
the  errors  associated  with  the  weights:  If  the  marginals  are  assessed  without 
error,  Oi  =  0,  then  the  true  scores  of  the  conditionals  are  irrelevant. 
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4.3     Comparing  Decomposition  to  Direct  Elicitation 

What  are  the  relative  sizes  of  the  errors  associated  with  direct  elicitation  and 
decomposition?  This  question  can  be  addressed  through  a  direct  comparison 
of  the  SEM  of  direct  elicitation,  (Jq,  to  the  SEM  of  decomposition,  a^,  as  de- 
rived above.  To  simplify  the  calculations,  consider  the  special  case  of  uniform 
SEMs  for  both  background  and  conditional  probabilities,  Oi  =  a  and  t^  =  t. 
Furthermore,  compare  the  two  techniques  while  varying  the  SEMs  of  the  com- 
ponent probabilities  as  a  function  of  the  SEM  of  direct  elicitation:  The  SEM  of 
the  background  probabilities  is  <r  =  kbOQ ,  while  the  SEM  of  the  conditionals  is 
7  =  kcOQ^  where  ki,  and  kc  are  positive  constants.  Using  these  assumptions,  it 
follows  from  equation  13  that: 

1=1  \=\ 

^2{n-\)[k,kcfal  (16) 


The  relative  size  of  the  measurement  errors  is  expressed  as  the  percent  change 
due  to  decomposition,  denoted: 

^  =  ^^::^  =  ^-i.  (17) 

Using  equation  16,  x  can  be  expressed  as: 

\      -  1.        (18) 


n-l  n  ^  1/2 

,2 


^=^I]('r» --/«)'  + ^^^?  +  2(n-l)^^^a2 

y    1=1  »=i 

A  value  of  x  =  0  indicates  identical  levels  of  measurement  error  for  both  tech- 
niques. Negative  values  indicate  an  improvement  due  to  decomposition,  while 
positive  values  indicate  that  decomposition  is  inferior. 

It  is  particularly  informative  to  derive  upper  and  lower  bounds  for  tt.  The 
upper  bound  can  be  derived  by  noting  that: 
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n-1 


^h-Tn)^     <     n-1 


»=1 


t=i 


'°     -     12- 


The  last  constraint  follows  from  the  fact  that  the  variance  of  a  random  variable 
defined  over  a  closed  interval  must  itself  be  constrained.  The  particular  con- 
straint chosen  here  is  based  upon  the  variance  of  a  random  variable  uniformly 
distributed  on  the  inten'al  [0, 1].  Using  equation  18,  the  upper  bound  is: 

1/2 

-  1-  (19) 


x<|^(n-l)  +  ^  +  fc?/:2(rL_2)| 


Similarly,  the  lower  bound  can  be  derived  from  the  following  constraints: 


t=i 

n 


t=l 

a?    >    0. 

This  results  in  the  expression: 

TT  >  -^  -  1.  (20) 

Figures  2,  3,  and  4  plot  the  upper  and  lower  bounds  of  tt  against  the  number 
of  conditioning  events,  n,  for  different  levels  of  kb  and  kc. 


Place  figures  2,  3,  &  4  about  here 


Figure  2  shows  how  n  can  vary  when  the  component  probabilities  have  the 
same  amount  of  error  as  direct  elicitation,  kt  =  kc  =  10.  The  potential  im- 
provement is  fairly  large,  with  a  30%  or  more  reduction  in  error  under  the 
best  conditions,  and  the  potential  improvement  becoming  larger  as  the  number 
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of  conditioning  events  increases.  On  the  other  hand,  the  worst  case  analysis 
indicates  that  decomposition  can  actually  result  in  a  substantial  increase  in 
measurement  error. 

What  accounts  for  this  wide  variation  in  the  effectiveness  of  decomposition? 
Inspection  of  equation  18  indicates  that  the  values  of  the  true  scores  for  both  the 
conditional  and  background  probabilities  are  critical.  Even  modest  deviations 
from  the  optimal  configuration  of  either  set,  as  described  above,  causes  rapid 
deterioration  in  performance.  Consider  the  following  numerical  example,  for  the 
case  of  n  =  4  conditioning  events:  Suppose  that  the  SEM  of  direct  elicitation  is 
moderately  high  (ao  =  0.1).*  Assuming  the  ideal  case,  with  uniform  values  of 
the  background  probabilities,  ^i  =  0.25  for  »  =  1 ...  4,  and  the  values  of  the  con- 
ditionals also  equal,  7i  =  72  =  73  =  74,  then  the  result,  from  equation  18,  is  a 
substantial  error  reduction  due  to  decomposition,  x  =  -0.44.  However,  if  while 
holding  everything  else  constant,  the  values  of  the  background  probabilities  are 
changed  so  that  Pi  =  0.7  while  ^2  =  i^a  =  ^4  =  0.1,  then  the  improvement  is 
cut  abnost  in  half,  tt  =  -0.24.  The  results  are  even  more  sensitive  to  the  values 
of  the  conditional  probabilities:  If  everything  else  is  held  constant  except  that 
the  value  of  74  is  changed  by  0.45,  then  the  improvement  due  to  decomposition 
almost  disappears,  tt  =  -0.04. 

Figure  3  illustrates  the  effect  of  increasing  the  values  of  kt  and  kc,  in  this 
case  assuming  that  the  errors  associated  with  the  components  are  50%  larger 
than  the  direct  assessment  [kb  =  kc  =  1.5).  Clearly,  the  potential  gains  fix)m 
decomposition  are  reduced  and,  for  n  =  2,  error  reduction  is  impossible  under 
even  the  best  circumstances.  As  kf,  and  kc  increase,  error  reduction  becomes 
infeasible  for  larger  and  larger  values  of  n. 

The  converse  case  is  illustrated  in  figure  4,  where  the  errors  associated  with 
the  components  are  50%  smaller  than  for  direct  assessment  (kb  =  kc  =  0.5). 
In  this  case,  the  opportunities  for  error  reductions  are  greater  and,  for  small 


*Tb«  rtiulti  of  thif  (xample  ftr«  not  •«niitiv«  to  th«  prtciic  v»lu(  of  dir«ct  •licltfttioo  <rror. 
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n,  improvements  occur  for  any  values  of  the  true  scores.  Thus,  as  ki,  and  kc 
decrease,  error  reduction  becomes  easier  and  less  dependent  on  the  choice  of 
conditioning  events. 

5     Dependent  Component  Elicitations 

There  are  two  assumptions  in  the  previous  analysis  that  warrant  further  dis- 
cussion. These  are  the  assumption  of  independence  for  conditional  probability 
elicitations,  and  the  assumption  of  partial  independence  of  marginal  probability 
elicitations.  These  are  now  discussed  in  turn. 

In  practice,  errors  in  the  elicitation  of  conditional  probabilities  could  well  be 
correlated  with  each  other  and  with  the  error  in  the  direct  elicitation  of  Pr(>l). 
For  instance,  suppose  an  assessor  uses  an  anchoring-and-adjustment  process  to 
estimate  each  Pr(A|B,),  where  the  assessor  starts  with  ('anchors  on')  the  direct 
elicitation  of  Pr(v4)  and  adjusts  it  according  to  knowledge  about  the  strength  of 
the  relationship  between  events  A  and  B,.  The  various  conditional  probabilities 
all  share  the  same  anchor,  but  each  one  has  a  unique  adjustment.  Since  each 
conditional  probability  is  influenced  by  the  error  in  the  shared  anchor,  this 
process  can  be  expected  to  produce  positive  correlations  among  the  errors  in 
the  conditional  probabilities  (for  a  proof,  see  Ravinder,  1986,  chapter  5), 

As  already  noted,  the  marginal  probabilities  can  not  be  completely  indepen- 
dent, since  coherence  requires  that  they  sum  to  1.  This  problem  was  initially 
handled  by  assuming  that  the  first  n  -  1  marginals  were  independent  while  the 
last  one,  fe„ ,  was  completely  determined  by  those  independent  probabilities.  A 
more  plausible  assumption  might  be  that  all  n  marginals  be  assessed  simulta- 
neously, with  the  errors  interrelated  in  a  more  complex  fashion.  However,  if 
coherence  is  maintained,  then  any  single  probability  bi  can  be  determined  from 
the  other  n  -  1  values  (i.e.,  the  correlation  between  6,  and  Yl^^j^i  ^  -lO)- 
This  in  turn  implies  that  any  two  marginals  6,  and  6y  have  negatively  correlated 
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errors. 

In  this  section,  our  analysis  is  extended  to  cover  these  two  cases.  In  partic- 
ular, a  generalization  of  equation  12  is  derived  that  allows  for  correlated  errors 
among  the  elicited  probabilities.  Following  this,  results  comparable  to  those 
presented  above  are  derived  for  the  case  of  uniform  negative  correlations  among 
the  marginals  and  uniform  positive  correlations  among  the  conditionals. 

5.1     The  Error  Variance  with  Dependent  Components 

The  notation  and  assumptions  of  the  previous  section  are  maintained  with  the 
following  modifications:  (a)  The  errors  in  the  marginal  elicitations  need  not  be 
independent,  but  rather,  have  a  correlation  denoted  by  Corr(6i,  6j)  =  0,y.  Note 
that  -1  <  <f>ij  <  1  for  I  ^  ;',  while  <l>ii  =  1.  (b)  Similarly,  the  errors  in  the 
conditional  elicitations  may  be  correlated,  denoted  by  Corr(€t,€y)  =  pij.  Also 
note  that  -I  <  Pij  <  I  for  t  ^  ;,  while  pa  =  1.  (c)  Finally,  independence 
between  the  marginals  and  conditionals  is  maintained:  Corr(6i,€y)  =  0  for  all  t 
and  ;'. 

Using  equation  3  as  the  starting  point,  the  variance  of  the  decomposition 
estimate  can  be  written  as  the  sum  of  a  set  of  covariances: 

(r3  =  Var[|^c6»  j  =^|^Cov(c6.,c,6,).  (21) 

An  expression  for  Cov{cibj,  Cjbj)  can  be  readily  obtained  because  the  c,  and  6^ 
terms  are  independent: 

Co\{cibi,Cjbj)    =    E{ciCjbibj)  -E{cibi)E{C]bj) 


Noting  that 


EiaCj)  =  7,7y  +  Cov{c,,  Cy), 
E(6.6J  =  A^j+Cov(6.,6,), 
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and  that 


it  then  follows  that: 


Cov(Ci,Cj)  =TiTjPij, 


Cov(6,,6j)=(T,ay^,j, 


Using  the  right-hand-side  of  this  last  expression  in  equation  21  produces  a 
general  formula  for  the  decomposition  error: 

n      n 

+  i;il(^«^OK^y)^..^.y-  (22) 

t=l;=l 

While  this  expression  is  quite  general,  only  certain  combinations  of  values 
of  Ci  and  ^^y  will  produce  coherent  probabilities  (i.e.,  marginal  probabilities 
that  sum  to  1).  In  order  to  satisfy  the  coherence  requirement,  it  is  necessary  to 
impose  restrictions  on  the  variance-covariance  matrix  for  the  marginal  assess- 
ments. Specifically,  the  restriction  is  that  for  each  i  =  1, . . . ,  n,  the  correlation 
between  6t  and  XlyjiJi^j  is  -1,  Any  variance-covariance  matrix  that  satisfies 
these  n  simultaneous  equations  will  be  coherent. 

As  an  example,  consider  the  assumptions  of  the  previous  section:  The  first 
n  -  1  marginals  were  assumed  to  be  independent,  (^ij  =  0  for  all  i  /  j,  where 
I  <  n  -  1  and  j  <  n  -  \.  In  order  to  maintain  the  coherence  constraint,  it 
then  follows  that  (^,„  =  -(a, /an)  for  t  =  1, . . . ,  n  -  1,  where  a^  =  Y!i=\  ^t- 
Furthermore,  by  letting  p,y  =  0  for  i  ^  j,  and  substituting  these  values  into 
equation  22,  it  is  easy  to  derive  equation  12  as  a  special  case. 
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5.2     Uniform  Negative  Correlation  of  Marginals 

Although  the  previous  assumptions  about  the  marginals  satisfy  the  coherence 
requirement,  many  other  assumptions  also  satisfy  that  requirement.  A  plau- 
sible alternative  is  to  let  the  correlation  among  the  marginals  be  uniform  and 
negative,  (f>tj  =  ^  <  0  for  t  /  ;'.  For  simplicity,  assume  uniform  error  variances 
for  the  marginal  probabilities,  af  =  a^  and  for  the  conditional  probabilities, 
T^  =  r^,  although  the  results  could  readily  be  extended  to  the  general  case. 

Since  coherence  implies  that  the  correlation  between  6,  and  X2?^,ftj  is  -1, 
it  follows  that: 

'{Var(E"/.'.)}"' 


Since 


and 


Coy{b„Ybj)  =  {n  -  l)<f>a^ 


Var(  V  hj)  =  (n  -  X^  +  (n  -  l)(n  -  2)^(t2, 

solving  for  <i>  indicates  that  the  coherence  condition  is  satisfied  when  <f>  — 
-l/(n  -  1).  Furthermore,  substituting  this  value  into  equation  22  produces 
the  following  expression  for  the  error  variance  of  decomposition  with  uniform 
negative  correlation  of  errors: 

^■T^Y^^I-^nah'^.  (23) 

1=1 

Examination  of  this  equation  leads  to  a  number  of  interesting  conclusions.  In 
the  first  place,  decomposition  error  no  longer  depends  upon  the  specific  choice 
of  event  6n,  as  it  did  in  the  previous  section.  On  the  other  hand,  a  number 
of  other  implications  of  equation  23  are  essentially  the  same  as  those  derived 


19 


from  equation  13  in  the  previous  section.  For  instance,  error  variance  is  stiU 
minimized  when  ^,  =  1/n.  Furthermore,  error  variance  is  minimized  when  the 
quantity 

n  n         n      n 

»=i  t=i  ]>t 

is  minimized.  This  occurs,  as  in  section  4,  when  7^  =  7^  for  1  ^  ;.  Finally,  as  the 

variances  t"^  and  <t^  approach  0,  the  error  variance  of  decomposition  decreases 

linearly.  Thus,  the  introduction  of  uniform  negative  correlation  of  errors  in  the 

marginals  does  not  substantially  alter  the  conclusions  derived  from  these  results. 

Several  of  the  results  from  the  previous  section  are  somewhat  modified.  For 

instance,  consider  the  derivation  of  n* ,  the  number  of  conditioning  events  that 

minimizes  error.    Letting  ^,  =  1/n  and  7,  =  7,  equation  23  produces  the 

following  expression  for  the  error  variance  of  decomposition: 

(T2  =  !!+n(T2r2  (24) 

Taking  the  first  derivative  of  the  right-hand-side  of  this  equation  with  respect 
to  n, 

Setting  this  result  equal  to  0  and  solving  for  n  produces  the  following  expression 

for  n*: 

n*  =  -.  (25) 

a 

This  value  is  somewhat  larger  than  the  value  derived  in  section  4,  particularly 
when  a  is  relatively  small. 

A  direct  comparison  of  equation  24  with  equation  14  is  also  informative.  In 
particular,  the  error  variance  derived  from  equation  24  is  smaller  than  the  value 
computed  in  the  previous  section,  with  the  difference  equal  to  (2  -  n)a^T^.  The 
results  in  section  4  seem  to  have  overstated  the  error  variance,  particularly  for 
large  values  of  n. 

Finally,  the  bounds  on  tt,  the  percent  change  due  to  decomposition,  need  to 
be  reevaluated.  Using  the  definitions  from  section  4.3  and  equation  23: 
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2  "     " 


»=i  ♦=ij>» 

1/2 


+^5;^^?+n^^M 


- 1-  (26) 


The  upper  bound  for  tt  can  be  derived  by  noting  that: 

1=1  »=i  j>%  ^         ' 

Using  these  inequalities  in  equation  26  results  in  a  revised  upper  bound: 

The  expression  for  the  lower  bound  is  unchanged  from  equation  20.  Comparison 
of  equation  27  to  equation  19  indicates  that  the  revised  upper  bound  for  t  are 
significantly  lower  than  the  original.  This  is  shown  in  figure  5,  which  plots  the 
original  and  revised  upper  bound  for  kb'=kc  =  \. 


Figure  5  about  here 


In  summary,  the  revised  assumption  of  uniform  negative  correlation  among 
marginals  has  no  serious  implications  for  the  analysis.  K  anything,  the  results 
presented  in  section  4  were  conservative,  understating  the  potential  error  reduc- 
tion benefits  of  decomposition. 

5.3     Positively  Correlated  Conditionals 

The  other  extension  of  the  previous  analysis  is  to  allow  the  errors  in  the  con- 
ditional probabilities  to  be  positively  correlated.  Again,  for  simplicity,  assume 
that  /3,j  =  /J  >  0  for  all  i  ^  ;.  As  before,  assume  that  ^ij  =  ^  =  -l/(n  -  1), 
Oi  —  a,  and  t^  =  r.  From  equation  22,  it  follows  that: 
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+  2^''f^f^U^,-jL\.  (28) 

1=1 J>»     \  / 


Equation  28  is  quite  similar  to  the  previous  expressions  for  decomposition 
error.  The  impact  of  positive  values  of  /)  is  linear.  When  ^i  =  1/n,  the  first 
derivative  of  equation  28  with  respect  to  p  is: 

This  expression  is  nonnegative  when  o^  <{n  -  l)/n^.  Recalling  that  the  vari- 
ance is  itself  constrained  (a^  <  1/12),  implies  that  this  condition  is  satisfied 
for  all  n  <  10.  Thus,  for  ten  or  less  conditioning  events,  positive  correlation  of 
conditionals  increases  the  error  variance  of  decomposition.  For  larger  numbers 
of  conditioning  events,  positive  correlation  increases  decomposition  error  when 
a^  is  small,  while  positive  correlation  actually  decreases  decomposition  error  for 
large  values  of  (T^. 

The  impact  of  correlated  conditionals  can  be  further  demonstrated  from  a 
revision  of  the  bounds  for  x.  Using  equation  28,  the  expression  for  percent 
change  due  to  decomposition  is: 

T  = 

t=l  t=l 3>%  1=1 

}l/2 
-  1-  (29) 

Positive  values  of  p  can  cause  dramatic  increases  in  the  lower  bound  for  n. 
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For  instance,  when  kf,  =  kc  =  1,  it  can  be  shown  from  equation  29  that: 

Thus,  large  values  of  p  reduce  the  potential  for  error  reduction  (i.e.,  the  lower 
bound  increases),  particularly  when  the  number  of  conditioning  events  is  large. 
On  the  other  hand,  positive  values  of  p  can  actually  improve  the  upper  bound 
for  n.  Again,  for  ki,  =  kc  =  1,  it  can  be  shown  from  equation  29  that: 

2  „^i/2 


-\4(n- 


-^+l  +  {l-p)-\       -1.  (31) 

As  p  approaches  1,  the  right-hand-side  of  this  expression  decreases.  Thus,  pos- 
itive correlation  of  conditionals  brings  the  upper  and  lower  bounds  for  jt  closer 
together. 

In  summary,  then,  positively  correlated  conditionals  may,  under  certain  cir- 
cumstances, seriously  under  cut  the  error  reduction  potential  of  decomposition. 
If  one  adopts  the  view,  introduced  in  section  4,  that  the  decomposition  estimate 
is  a  weighted  average  of  the  conditional  probabilities,  then  this  result  seems 
reasonable.  Positive  correlation  implies  that  the  quantities  being  averaged  are 
to  some  extent  redundant,  reducing  the  benefit  to  be  derived  from  the  averaging 
process.  The  exception  occurs  when  the  errors  in  the  weights  (a^)  are  large.  In 
this  case,  a  large  number  of  redundant  conditionals  may  help  offset  the  error  in 
the  weights. 

6     Discussion 

Our  results  provide  some  concrete  reconmiendations  for  analysts  interested  in 
structuring  probability  encoding  tasks  in  order  to  minimize  inconsistency: 

1.  With  the  proper  choice  of  conditioning  events,  decomposition  can  reduce 
random  errors  associated  with  probability  encodings. 
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2.  As  the  number  of  events  increases,  error  reduction  will  only  occur  up  to 
a  point,  and  the  effort  required  to  assess  additional  probabilities  will,  on 
the  mar^n,  not  be  warranted.  On  the  other  hand,  excessive  concern  with 
the  number  of  events  is  probably  not  warranted,  since  the  amount  of  error 
is  generally  not  sensitive  to  small  deviations  from  the  optimal  number  of 
conditioning  events. 

3.  The  marginal  probabilities  of  the  conditioning  events  should  be  selected 
to  be  equal,  unless  there  are  known  differences  in  the  precision  of  the 
conditional  probabilities.  In  that  case,  adjustments  to  the  relative  sizes  of 
the  marginals  are  desirable. 

4.  The  conditional  probabilities  should  ideally  be  as  close  as  possible.  Of 
course,  if  all  the  conditional  probabilities  are  knovm  to  be  equal,  then 
we  would  not  really  need  to  bother  with  decomposition.  The  extent  to 
which  the  assessor  or  the  analyst  has  control  over  the  range  of  values  of 
conditional  probabilities  is  not  at  all  clear,  so  this  reconmiendation  may 
be  diflBcult  to  implement. 

5.  The  errors  associated  with  the  assessment  of  the  component  probabilities 
should  be  as  smaU  as  possible.  In  particular,  selection  of  conditioning 
events  whose  marginals  are  precisely  known  is  desirable. 

6.  The  analyst  should  try  to  verify  and  maintain  the  independence  of  the 
component  assessments.  Specifically,  dependencies  among  the  conditional 
probabilities  could  easily  undermine  the  value  of  decomposition. 

Unfortunately,  in  practice  it  may  be  quite  difficult  to  follow  all  of  these  rec- 
ommendations simultaneously.  For  instance,  a  class  of  conditioning  events  that 
satisfies  several  of  the  conditions  above  are  equiprobable  events  like  the  toss  of 
a  coin  or  the  roll  of  a  die.  Not  only  are  the  marginal  probabilities  uniform, 
but  they  can  be  assessed  without  error.  For  instance,  one  might  estimate  the 
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probability  of  a  target  event  conditional  upon  the  toss  of  a  fair  coin  resulting  in 
heads,  and  then  assess  the  probability  conditional  upon  the  coin-toss  resulting 
in  tails.  Unfortunately,  a  single  individual  wiU  probably  not  be  able  to  assess 
these  two  conditional  probabilities  without  introducing  dependencies,  and  the 
advantages  of  averaging  may  be  dissipated.  Alternately,  the  assessments  of  con- 
ditional probabihties  could  be  obtained  from  different  assessors.  This  essentially 
transforms  the  decomposition  process  into  the  problem  of  aggregating  the  opin- 
ions of  n  independent  judges.  Of  course,  even  introducing  multiple  assessors  will 
not  guarantee  the  removal  of  dependencies  (for  further  discussion,  see  Clemen 
k  Winkler,  1985). 

As  with  any  analysis  of  this  type,  the  utility  of  the  results  depends  upon 
the  credibility  of  the  assumptions.  For  instance,  the  calculation  of  error  bounds 
depend  upon  a  ceteris  paribus  assumption — that  the  error  of  the  component 
elicitations  remains  constant  as  the  number  of  conditioning  events  increase.  In 
point  of  fact,  as  the  number  of  conditioning  events  increases,  the  assessor's  work 
load  will  increase,  potentially  increasing  fatigue  and  decreasing  the  consistency 
of  the  component  elicitations.  Fortunately,  this  simply  reinforces  the  conclusion 
that  overly  large  values  of  n  are  undesirable. 

Another  assumption,  equal  error  variances,  introduced  in  equation  13  and 
used  for  the  derivation  of  error  bounds,  is  in  large  part  a  convenience  rather 
than  a  necessity.  Similar  results  could  be  derived  using  equation  12  for  any 
arbitrary  set  of  error  variances.  What,  then,  are  the  circumstances  where  equal 
error  variances  are  a  reasonable  assumption?  An  important  factor  could  be  the 
size  of  the  expected  (true)  values.  Consider  the  case  where  the  error  distribution 
is  assumed  to  be  continuous  and  unimodal  over  the  interval  (0, 1).  As  the  true 
values  approach  either  0  or  1,  the  error  variance  wiU  be  constrained,  and  will 
approach  zero.  (Larger  variances  are  only  possible  if  the  distribution  has  more 
than  one  mode  or  is  discontinuous.)  Thus,  for  events  whose  true  probabilities 
vary  widely  (e.g.,  from  0.5  down  to  0.0001),  equal  error  variances  seem  less  plau- 
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sible  than  for  events  whose  probabilities  are  roughly  equal.  If  the  probabilities 
utilized  in  the  decomposition  do  cover  an  extreme  range,  the  analyses  should 
be  repeated  with  more  appropriate  variance  estimates. 

This  research  describes  a  very  general  framework  for  analyzing  the  nature 
of  random  errors  and  evaluating  strategies  for  controlling  those  errors.  To  the 
extent  that  some  of  the  assumptions  seem  arbitrary  or  unfounded,  empirical 
research  may  be  appropriate.  In  particular,  measurement  of  the  variances  and 
covariances  of  random  assessment  errors  in  a  variety  of  assessment  domains 
may  prove  quite  informative.  Observation  of  actual  assessors  using  decompo- 
sition may  also  shed  hght  on  important  sources  of  systematic  errors  that  are 
not  addressed  by  the  present  analytical  framework.  For  instance,  probabilities 
derived  from  different  decompositions  could  well  differ  in  a  systematic  fashion. 
To  reiterate  a  point  made  above,  control  of  random  error  is  a  necessary  though 
not  suflBcient  condition  for  accurate  assessment.  It  is  informative  to  note  that 
systematic  errors  have  proven  to  be  quite  difficult  to  control  (e.g.,  Fischhoff, 
1982).  On  the  other  hand,  a  decomposition  approach  is  quite  simple  from  a 
conceptual  perspective,  is  relatively  easy  to  implement,  and  seems  to  have  real 
potential  for  reduction  of  an  important  source  of  error. 
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Appendix 

This  appendix  demonstrates  that  equation  11  is  equivalent  to  equation  12.  For 
the  first  component  of  the  right-hand  side  of  equation  11,  because  of  inde- 
pendence assumptions,  it  follows  that  Var(^"r/  c^fc,)  =  ]^"r/  Var(ci6i).  The 
independence  conditions  aLso  imply  that 

VarM0  =  'r.M+AV+^?7f- 
Therefore, 

Var  (y  ca]  =  y  7^?  +  T  0^r^  +  T  ohl  (32) 

^1=1       I      t=i  »=i  t=i 

The  second  component  can  be  expanded  as  foUows: 
Var  [c„  I  1-^6, 

7?  Var  [  1  -  |;  fc.  I  +  1 1  - 1;  ^A    ^n  +  Var  1 1  - 1;  6,  j  rl 

Since  Var{l  -  Yl-Zl^j)  =  Ey=/^^(^)  ^^  since  Var(6j)  =  (jj,  it  foUows 
directly  that: 

lj  X:  <r?  +  fl  -  g  ft  )    4  +  rlt  "f  'l  (33) 

j=i  \^      )=i     J  y=i 

The  third  term  from  the  right-hand  side  of  equation  1 1  (excluding  the  constant) 
can  be  rewritten  as  follows: 
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'n-1  I         n-l 

Gov  I  Vct^.Cn   M  -  51^^ 


n— 1  n— 1  /  n— 1 


^  Gov  (ct6,,  Cn)  -  ^  Gov    Cifc,,  c„  V  6j 


1=1  1=1         \  j=i 

This  expression  simplifies  considerably,  since  Gov(c»6,,c„)  =  0  for  all  values  of 
»  <  n  -  1,  and  Cov(ci6i,  c„  ^?r/  6y)  =  0  except  when  i  =  j.  Since 

Gov(c,-6,-,c„6,)  =  E(c„c,6?)  -  7n7t/^, 


and  since 


therefore; 


E(6?)  =  ^  +  a?, 


(n-l  /  n-l 

-7nr7t(A'+^?)  +  7nr7»^?, 

^  »=1 

which  is  equivalent  to: 

(n-l  I         n-l      A  \  n-l 

^  C.6„  Cn       1  -  ^  6;  =  -7n  J^  7.<^?.  (34) 

Substituting  the  right-hand-sides  of  equations  32,  33,  and  34  into  equation  11 
and  noting  that 

r  ito^  +  7^  r  of  -  27n  V  7.^?  =  r  ^?(7,  -  7n  ? 
»=i  ^  7=1  f=i 

and  that 

n-l  /         n-l       \2  n 

E^'^'  +  M-E^O  ^'  =  E^'^' 
«=i       \^    «=i  )      1=1 

produces  equation  12. 
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Figure  Captions 


Figure  1:  Error  as  a  Function  of  Number  of  Conditioning  Events 

Figure  2:  Upper  and  Lower  Error  Bounds — kb  =  ^^  =  1.0 

Figure  3:  Upper  and  Lower  Error  Bounds — kb  =  kc=  1.5 

Figure  4:  Upper  and  Lower  Error  Bounds — kb  =  kc  =  0.5 

Figure  5:  Revised  Error  Bounds — kb  =  kc  =  1.0 
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SEM  of  Decomposition 
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